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VIEW DEPENDENT TILED TEXTURES 

5 

Field of the Invention 

The present invention relates to tiled texture mappings in 
computer graphics displays and, in particular, to tiles that that are rendered 
according to different user viewing angles. 

10 Background and Summary of the Invention 

In computer graphics texture mapping refers to adding texture, 
color, shading, illumination, transparency, as well as other image attributes, 
to the surface of an image geometry to increase the detail and realism in 
an image. (In this context, image geometry refers to an image surface to 

1 5 be rendered on a video display and is not a limited to image objects 

representing solid articles.) Commonly, texture mapping utilizes a texture 
tile (or tiled texture) that includes the image attributes of the texture and is 
typically smaller than the image geometry to which the texture mapping is 
applied. As a result, texture mapping often entails applying an array of 

20 many copies of the texture tile to the image geometry (i.e., tiling) to cover it 
with the image or surface texture. Texture mapping simplifies image 
processing by allowing image modeling calculations to be based on image 
geometries alone without also having to model relatively high resolution 
and complex surface details. 

25 Conventional tiled textures and texture mapping suffers from 

relatively poor depth characteristics and therefore lack realism. An 
example of a common tiled texture that commonly suffers from these 
disadvantages is a brick wall. An actual brick wall is characterized by rich 
three-dimensional structures in which adjacent bricks are separated by 

30 mortar. Typically, the mortar is recessed relative to the front major faces of 
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the bricks. When viewed from most angles, the relative depths of the brick 
faces and mortar are plainly discernible. 

Texture mapping is the general process of wrapping an image 
around a geometry and rendering the results. A conventional tiled texture 
5 is a single tile that is rendered repeatedly in an array to form an image. In 
conventional texture mapping for computer graphics, however, the depth 
characteristics of the typical tiled texture of for example a brick wall are 
lacking. In this example, the tile may be of a single brick or, more likely, is 
of a group of bricks mortared together. The tile may include apparent 

10 depth characteristics between the mortar and bricks included in the tile. 
Even with the apparent depth characteristics of such a tile the resulting tile 
mappings applied to image geometries lack apparent depth. Such texture 
mappings look like printed wall paper rather than a three-dimensional form. 
In accordance with the present invention, the loss of the 

1 5 apparent depth in texture mappings may be averted by employing an array 
of view-dependent sprited tiles that provide different views of an image 
texture (e.g., structure, color, shading, illumination, transparency, as well 
as other image attributes). The different views of the image texture 
correspond to different viewing angles at which a user would see the tiles 

20 when they are applied to an image geometry. In one implementation, the 
viewing angles are based upon the horizontal angles (i.e., angles within a 
horizontal plane of a user's view) at which the user views the tiles. This 
implementation is considered to be view dependent in one (angular) 
dimension or, alternatively, a one-dimensional array of sprited tiles. Tiles 

25 in accordance with this invention can also be based upon other single 

angular dimensions (e.g., vertical and others) or multiple (e.g., two) viewing 
angle dimensions. 

In one implementation, the view dependent sprited tiles are 
two-dimensional projections of three-dimensional structures. The typical 

30 projections for applying or projecting a three-dimensional structure onto a 



1026-006 112375.1 - 3 - EXPRESS MAIL NO. EL036931958US 

two-dimensional representation or image plane are the perspective 
projection and the orthographic projection. Neither projection is desirable 
for providing such view dependent sprited tiles. Whenever tiles formed by 
perspective or orthographic projections at different viewing angles are 
5 positioned together, image artifacts arising from inconsistencies in their 
views undermine the goal of improved depth characteristics. 

In particular, tiles with perspective projections undergo second 
perspective projections after the tiles are applied to an image geometry, 
which results in undesirable image artifacts. Orthographic projections 

1 0 introduce apparent rotation of the image plane for different viewing angles. 
This apparent rotation can introduce changes in the apparent shapes of 
tiles that are near each other, but are viewed at different viewing angles. 
The image artifacts from perspective and orthographic projections can 
appear as Inconsistencies in the appearances of adjacent tiles or in the 

1 5 appearance of the image geometry to which the tiles are applied. 

To avoid such image artifacts, view dependent sprited tiles are 
formed in one implementation by oblique parallel projections. Oblique 
parallel projections do not introduce perspective foreshortening or apparent 
rotation of the image plane for different viewing angles. In view dependent 

20 sprited tiles that are two-dimensional projections of a three-dimensional 
structure, for example, and in which the three-dimensional structure has a 
front surface that is the generally major surface of the three-dimensional 
structures in the tiles (i.e., the surface that is about parallel to the plane of 
a tile), an oblique parallel projection maintains the dimensions (including 

25 shape) of the front surface at different viewing angles. 

Additional objects and advantages of the present invention will 
be apparent from the detailed description of the preferred embodiment 
thereof, which proceeds with reference to the accompanying drawings. 
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Brief Description of the Drawings 

Fig. 1 is a block diagram of a computer system that may be 
used to implement the present invention. 

Fig. 2 is an illustration of an exemplary one-dimensional array 
5 of view-dependent sprited tiles having respective textures that are of a 
simplified texture structure in the form of a solid block casting a shadow. 

Fig. 3 is a front view of a display screen illustrating a user 

viewpoint. 

Fig. 4 is a front view illustration of a display screen having 
10 rendered thereon an exemplary two-dimensional array of view-dependent 
sprited tiles having respective textures that are of a simplified structure in 
the form of a solid block casting a shadow. 

Fig. 5 is a bottom end view of a display screen to illustrate 
horizontal viewing angle. 
15 Fig. 6 is a side end view of a display screen to illustrate vertical 

viewing angle. 

Fig. 7 is a flow diagram of a texture mapping method for 
rendering a texture on an image surface to be displayed for a user. 

Fig. 8 is a flow diagram of another texture mapping method for 
20 rendering a texture on an image surface to be displayed for a user. 

Fig. 9 illustrates two examples of a conventional prior art 
perspective projection at different viewing angles. 

Figs. 10A and 10B show different adjacent perspective views 
and illustrate imaging artifacts that arise from adjacent perspective views at 
25 different viewing angles. 

Fig. 11 illustrates two examples of a conventional prior art 
orthographic projection at different viewing angles. 

Fig. 12 illustrates two examples of an oblique parallel 
projection at different viewing angles. 
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Fig. 1 3 is a flow diagram of a metliod of generating view 
dependent sprited tiles. 

Detailed Description of Preferred Embodiment 

Fig. 1 illustrates an operating environment for an embodiment 
5 of the present invention as a computer system 20 with a computer 22 that 
comprises at least one high speed processing unit (CPU) 24 in conjunction 
with a memory system 26, an input device 28, and an output device 30. 
These elements are interconnected by at least one bus structure 32. 

The illustrated CPU 24 is of familiar design and includes an 
1 0 ALU 34 for performing computations, a collection of registers 36 for 
temporary storage of data and instructions, and a control unit 38 for 
controlling operation of the system 20. The CPU 24 may be a processor 
having any of a variety of architectures including Alpha from Digital, MIPS 
from MIPS Technology, NEC, IDT, Siemens, and others, x86 from Intel and 
1 5 others, including Cyrix, AMD, and Nexgen, and the PowerPC from IBM and 
Motorola. 

The memory system 26 generally includes high-speed main 
memory 40 in the form of a medium such as random access memory 
(RAM) and read only memory (ROM) semiconductor devices, and 

20 secondary storage 42 in the form of long term storage mediums such as 
floppy disks, hard disks, tape, CD-ROM, flash memory, etc. and other 
devices that store data using electrical, magnetic, optical or other recording 
media. The main memory 40 also can include video display memory for 
displaying images through a display device. Those skilled in the art will 

25 recognize that the memory 26 can comprise a variety of alternative 
components having a variety of storage capacities. 

The input and output devices 28 and 30 also are familiar. The 
input device 28 can comprise a keyboard, a mouse, a physical transducer 
(e.g., a microphone), etc. The output device 30 can comprise a display, a 
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printer, a transducer (e.g., a speaker), etc. Some devices, sucli as a 
network interface or a modem, can be used as input and/or output devices. 

As is familiar to tliose skilled in the art, the computer system 
20 further includes an operating system and at least one application 
5 program. The operating system is the set of software which controls the 
computer system's operation and the allocation of resources. The 
application program is the set of software that performs a task desired by 
the user, using computer resources made available through the operating 
system. Both are resident in the illustrated memory system 26. 

10 In accordance with the practices of persons skilled in the art of 

computer programming, the present invention is described below with 
reference to acts and symbolic representations of operations that are 
performed by computer system 20, unless indicated otherwise. Such acts 
and operations are sometimes referred to as being computer-executed and 

1 5 may be associated with the operating system or the application program as 
appropriate. It will be appreciated that the acts and symbolically 
represented operations include the manipulation by the CPU 24 of 
electrical signals representing data bits which causes a resulting 
transformation or reduction of the electrical signal representation, and the 

20 maintenance of data bits at memory locations in memory system 26 to 

thereby reconfigure or otherwise alter the computer system's operation, as 
well as other processing of signals. The memory locations where data bits 
are maintained are physical locations that have particular electrical, 
magnetic, or optical properties corresponding to the data bits. 

25 Fig. 2 is an illustration of an exemplary array of view- 

dependent sprited tiles 202A-202E having respective textures 204A-204E 
that are of a simplified texture structure in the form of a solid block 206 
having a front or outer surface 207 and casting a shadow 208. Front 
surface 207 is the generally major surface of block 206 in tiles 202. 

30 Shadow 208 represents the result of an illumination source (not shown) 
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that enhances the representation of textures 204, as is common in the field 
of texture mapping. Shadow 208 extends beyond each of tiles 202 and is 
represented by a shadow segment 210 on each adjacent tile 202. In a 
texture mapping, sprited tiles 202 are applied to a surface of an image 
5 geometry to increase the detail and dynamic realism in an image rendered 
for a user on a display screen 212 (shown on edge). Tiles 202 are shown 
perpendicular to the plane of display screen 212 for purposes of 
illustration. 

It will be appreciated that view-dependent sprited tiles 

1 0 according to the present invention could be of arbitrary complexity and 
include arbitrary levels of imaging detail and that the detail of textures 204 
has been simplified for purposes of illustration. In this context, image 
geometry refers to an image surface to be rendered on a video display and 
is not limited to image objects representing solid articles. 

1 5 Sprited tiles 202A-202E provide different views of the 

geometry of texture structure block 206 in respective textures 204A-204E. 
The different views of block 206 correspond to different viewing angles 
214A-214E at which a user would see tiles 202 when they are applied to 
an image geometry. In this example, tiles 202 are two-dimensional 

20 projections of three-dimensional structures. Viewing angles 214 are 

determined with respect to a selected user viewpoint 216 that is assigned a 
preselected distance 218 from display screen 212. At the relatively large 
viewing angle 21 4D of tile 202D, for example, tile 202E includes a texture 
block segment 220 representing a partial overlap of texture structure 206 

25 from adjacent tile 202D. 

Fig. 3 is a front view of display screen 212 illustrating user 
viewpoint 216. In addition to its distance 218 (shown in Fig. 2, extending 
out of the plane of Fig. 3) from display screen 212, user viewpoint 216 is 
also assigned preselected horizontal position 302 relative to a horizontal 

30 axis 304 across display screen 212. (For example, horizontal position 302 
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could be at a midway point across horizontal axis 304.) Distance 218 and 
horizontal position 302 are selected to represent an average or typical 
viewing distance and position for many users. 

Horizontal position 302 establishes user viewpoint 216 as a 
5 vertical line 306 that is parallel to display screen 212 and spaced apart 
from it by distance 218. In this implementation ,the viewing angle 214 at a 
selected position on an image surface on display screen 212 is determined 
as the horizontal angle between a normal 220 extending from the image 
surface at the selected position and a viewing line 220 extending from the 

10 selected position to viewpoint 216. With their viewing angles 214 based 
upon horizontal angles alone, tiles 202 are considered to be view 
dependent in one (angular) dimension or, alternatively, a one-dimensional 
array of sprited tiles. Tiles in accordance with this invention can be based 
upon other single angular dimensions (e.g., vertical) or multiple (e.g., two) 

1 5 viewing angle dimensions, as described below in greater detail. 

Multiple tiles 202 (e.g., 5-19 or more) may be determined or 
calculated prior to rendering for use over a range of viewing angles to 
provide a retained mode, real time rendering system. With the exemplary 
viewpoint 216 (i.e., viewpoint line 306) at about the horizontal middle of 

20 display screen 212, both positive and negative viewing angles 214 would 
be included in the range of viewing angles (e.g., + 52.5°), although only 
positive angles are shown. Accordingly, for the positive viewing angle of 
each tile 202, array 200 would typically include a tile 202 with a negative 
viewing angle of the same absolute value. This would reflect the typical 

25 user viewpoint 21 6 as being generally horizontally centered with regard to 
display screen 212. 

In this implementation, each of tiles 202 would correspond to a 
particular viewing angle segment within the range of viewing angles 214. 
The viewing angle segments that are assigned to tiles 202 may be 

30 distributed uniformly over the viewing angle range (e.g., each tile 202 
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corresponds to a viewing angle segment of 5° over a range of + 52.5°) or 
may be distributed In any nonuniform manner. For example, the density of 
tiles may be concentrated near the normal (i.e., 0°) viewing angle to 
provide greater imaging quality according to the given texture and 
5 application. 

Fig. 4 is a front view illustration of a display screen 402 having 
rendered thereon an image surface 403 with an exemplary two- 
dimensional array of view-dependent sprited tiles 404AA-404DF having 
respective textures 406AA-406DF that are of a simplified structure In the 
10 form of a solid block 408 (only one numbered) casting a shadow 410 (only 
one numbered). Shadow 410 represents the result of an illumination 
0 source (not shown) that enhances the representation of textures 406, as Is 

u common in the field of texture mapping. 

J'S it will be appreciated that view-dependent sprited tiles 

1 5 according to the present invention could be of arbitrary complexity and 
M include arbitrary levels of imaging and that the detail of textures 406 has 

M been simplified for purposes of illustration. In a texture mapping, sprited 

J tiles 404 are applied to a surface of an Image geometry to Increase the 

II detail and realism In an image rendered for a user on a display screen 402. 

gi 20 In this context, image geometry refers to an image surface to be rendered 

on a video display and is not a limited to image objects representing solid 

articles. 

Sprited tiles 404AA-404DF provide different views of block 408 
in respective textures 406AA-406DF. The different views of block 408 

25 correspond to different horizontal viewing angles 41 2 and vertical viewing 
angles 414 at which the user can see tiles 404. In this Implementation, 
tiles 404 are two-dimensional representations of three-dimensional 
stmctures. Viewing angles 412 and 414 are determined with respect to a 
selected user viewpoint 416. Being based upon horizontal and vertical 

30 viewing angles, tiles 404 are considered to be view dependent in two 
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(angular) dimensions or, alternatively, a two-dimensional array of sprlted 
tiles. 

Horizontal viewing angle 412 and vertical viewing angle 414 
are illustrated for exemplary tile 404DE, but viewing angles 412 and 414 
for remaining tiles 404 are determined in the same manner. User 
viewpoint 416 is positioned relative to horizontal and vertical coordinate 
axes (not shown) on display screen 402. Viewpoint 416, like viewpoint 216, 
is selected to represent an average or typical viewing distance and position 
for many users. 

Fig. 5 is a bottom end view of image surface 403 to Illustrate 
horizontal viewing angle 412. Image surface 403 is shown as being flat 
for purposes of illustration, but in practice could be of arbitrary shape. 
Referring to Figs. 4 and 5, the horizontal position of user viewpoint 416 
establishes a vertical viewpoint line 420 that is parallel to display screen 
402 and spaced apart from image surface 403 by a distance 500. The 
horizontal viewing angle 412 at a selected position on image surface 403 
(e.g, tile 404DE ) is determined as the horizontal angle between a normal 
502 extending from image surface 403 at the selected position and a 
viewing line 504 extending from the selected position to vertical viewpoint 
line 420. 

Fig. 6 is a side end view of image surface 403 to illustrate 
vertical viewing angle 414. Referring to Figs. 4 and 6, the vertical position 
of user viewpoint 416 establishes a horizontal viewpoint line 422 that is 
parallel to display screen 402 and spaced apart from it by the distance 500. 
The vertical viewing angle 414 at a selected position on image surface 403 
(e.g, tile 404DE ) is determined as the vertical angle between a normal 602 
extending from image surface 403 at the selected position and a viewing 
line 604 extending from the selected position to horizontal viewpoint line 
422. . 



> 
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Multiple tiles 404 may be predetermined for Cise over a range 
of viewing angles. It will be appreciated, however, that for a one- 
dimensional-array of N-number of sprited tiles (e.g., tiles 202), a two- 
dimensional-array of sprited tiles (e.g., tiles 404) of corresponding 
5 resolution would have N^-number of tiles. Alternatively, a two-dimensional 
array of tiles could use fewer numbers of represented views to decrease 
the overall number of tiles. Also, the resolution of each of the tiles need 
not be the same. For instance tiles representing views that are at larger 
viewing angles might be at lower resolutions and require fewer pixels. 
1 0 With the exemplary viewpoint 416 positioned at about the 

horizontal middle of display screen 402, positive and negative horizontal 
0 viewing angles 41 2 would be equally included in the range of viewing 

•u angles. Accordingly, for each tile 404 having a positive viewing angle there 

j^, would also typically be a tile 404 with a negative viewing angle of the same 

N 1 5 absolute value. This would reflect the typical user viewpoint 41 6 as being 

Hi 

m generally horizontally centered with regard to display screen 402. 

In this implementation, each of tiles 404 would correspond to a 
particular horizontal and vertical viewing angle segment within the range of 
K viewing angles 412 and 414. The viewing angle segments that are 

5 20 assigned to tiles 404 may be distributed uniformly over the viewing angle 
ranges or may be distributed in any nonuniform manner. For example, the 
density of tiles may be concentrated near the normal (i.e., 0°) viewing 
angles to provide greatest imaging quality according to the texture and 
application. 

25 Fig. 7 is a flow diagram of a texture mapping method 702 for 

rendering a texture on an image surface to be displayed for a user. 
Method 702 is described as mapping a one-dimensional array of sprited 
tiles (e.g., tiles 202) to an image surface. For purposes of generalization, 
this description notes differences between the mapping of one- and two- 

30 dimensional arrays of sprited tiles (e.g., tiles 202 and 404, respectively). 
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Method 702 is described with reference to a predefined set of sprited tiles 
202. It will be appreciated, however, that tiles 202 could alternatively be 
determined in real-time, as described below with reference to Fig. 8. 

Process block 704 indicates that a set of sprited tiles are 
5 stored in a computer readable medium to be available for the texture 
mapping process. Each sprited tile is correlated with a viewing angle 
range segment. The viewing angle range segments of the different sprited 
tiles may or may not be of equal angular extent or resolution. 

Process block 706 indicates that an image surface is selected 
10 to be textured with tiles 202. 

Process block 708 indicates that an initial region of the image 
surface is identified. The initial region is of the size of the sprited tiles, or a 
segment of one of them. The initial region could be selected in any 
manner. For example, the initial region could be selected as the portion of 
1 5 the image surface that is at the right-most extent of the highest level of the 
image surface on the display screen. 

Process block 710 indicates that a viewing angle is determined 
for the Identified region of the image surface. With reference to Fig. 3, for 
example, the horizontal viewing angle is determined as the horizontal 
20 angle between a normal 224 extending from the image surface at the 
selected position and a viewing line 216 extending from the selected 
position to viewpoint 212. In a two-dimensional implementation, horizontal 
and vertical viewing angles, for example, are determined. 

Process block 712 indicates that the determined viewing angle 
25 is correlated with the sprited tile having the viewing angle range segment in 
which the determined viewing angle falls. 

Process block 714 indicates that the sprited tile correlated with 
the viewing angle, or a portion of the tile, is rendered on the identified 
region of the image surface. A portion of a sprited tile could be rendered. 
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for example, along an edge or boundary of the innage surface, as is known 
in the art for conventional texture mapping. 

Query block 716 represents an inquiry as to whether the image 
surface includes another region to be texture mapped. Subsequent 
5 regions to be mapped may be identified in any of a variety of ways or 
sequences as is known in the art. Whenever the image surface includes 
another region to be texture mapped, query block 716 returns to process 
block 710. Otherwise, query block 716 proceeds to termination block 718. 
Fig. 8 is a flow diagram of another texture mapping method 
1 0 802 for rendering a texture on an image surface to be displayed for a user. 
Method 802 is also described as mapping to an image surface a one- 
dimensional array of sprited tiles (e.g., tiles 202) that are determined in 
real-time. 

Process block 804 indicates that an image surface is selected 
15 to be textured with tiles 202. 

Process block 806 indicates that an initial region of the image 
surface is identified. The initial region is of the size of the sprited tiles, or a 
segment of one of them. The initial region could be selected in any 
manner. For example, the initial region could be selected as the portion of 
20 the image surface that is at the right-most extent of the highest level of the 
image surface on the display screen. 

Process block 808 indicates that a viewing angle is determined 
for the identified region of the image surface. 

Process block 810 indicates that a sprited tile is determined or 
25 calculated by applying a projection (e.g., an oblique parallel projection) at 
the determined viewing angle to an image geometry corresponding to the 
tile. As an alternative, the determined viewing angle may be correlated 
with one of multiple viewing angle range segments, and the sprited tile may 
be calculated with respect to a selected viewing angle in substitution for 
30 determined viewing angles that fall within the viewing angle range 



1026-006 112375.1 



- 14- 



EXPRESS MAIL NO. EL036931958US 



segment. For example, a selected viewing angle of 12.5'' could be 
substituted a determined viewing angle of 1 1°, or any other determined 
viewing angles falling within in a viewing angle range segment of lO'^-IS^. 

Process block 812 indicates that the determined sprited tile, or 
5 a portion of the tile, is rendered on the identified region of the image 
surface. A portion of a sprited tile could be rendered, for example, along 
an edge or boundary of the image surface, as is known in the art for 
conventional texture mapping. 

Query block 814 represents an inquiry as to whether the image 
1 0 surface includes another region to be texture mapped. Subsequent 
regions to be mapped may be identified in any of a variety of ways or 
0 sequences as is known in the art. Whenever the image surface includes 

another region to be texture mapped, query block 814 returns to process 
block 808. Otherwise, query block 814 proceeds to termination block 816. 
15 Texture mapping methods 702 and 802 provide texture 

IE mapping having improved depth characteristics over conventional texture 

y mapping. It will be appreciated, however, that certain artifacts can be 

12 discerned by a viewer under some imaging conditions when a tile of one 

CB viewing angle is applied for all the viewing angles in a viewing angle range 

m 20 segment. If the viewer distance is small relative to the tile size, the tiles 

corresponding to some viewing angles might be skipped, resulting in 
discernible differences between adjacent tiles corresponding to non- 
adjacent viewing angle segments. 

A related artifact can arise as the viewer distance to a tile 
25 decreases (e.g., the viewer moves closer to the tile). In this circumstance, 
the viewing angles to opposed sides of a single tile can differ sufficiently 
that two different view-dependent tiles could correspond to the two viewing 
angles. Selection of one tile over another in this circumstance will lead to 
an artifact. (In one implementation, viewing angles are determined with 
30 reference to the centers of the tiles.) In other implementations, for 
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example, texture mapping processes 702 and 802 could blur, blend, or 
morph between selected tiles of different viewing angles to improve 
accuracy of resultant images over a wider set of angles and reduce 
artifacts from insufficient resolution of angles. Morphing is a process by 
5 which one image is gradually transformed into another, creating the illusion 
of a metamorphosis. 

Texture mapping methods 702 and 802 apply sprited tiles to 
image surfaces to provide more realistic images. The geometrical 
complexity of the sprited tiles correlates with the increased realism that the 

10 sprited tiles can provide. But increased geometrical complexity also 

requires computer systems with correspondingly greater rendering speed, 
texture storage, and mapping speed. As a result, the geometrical 
complexity of the sprited tiles is typically balanced against the increased 
realism of images with the sprited tiles to provide suitably realistic images 

1 5 that accommodate the resources and capabilities of the computer systems. 

The view-dependent image characteristics of the sprited tiles 
are provided by projecting a texture structure (e.g., block 206) according to 
views corresponding to the different viewing angles. A projection is a 

20 mathematical technique or function for converting a three-dimensional 
representation into two-dimensional representation (e.g., on a projection 
plane) to be rendered on a display screen. The two common graphics 
imaging projections are perspective and orthographic projections. 

Fig. 9 illustrates two examples of conventional prior art 

25 perspective projection 902 (902') at different viewing angles. Perspective 
projections have converging projection lines 904 (904') from an image 906 
pass through a common point 908 (908'), called the center of projection, to 
achieve depth realism for a viewer or "camera" 910 (910') viewing an 
image plane 912 (912'). The problem with using perspective projection to 

30 generate tiles is that perspective foreshortening ends up being applied 
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twice, once when rendering tiie tile and a second time when rendering the 
resultant scene. This results in an unrealistic resultant image. 

Fig. 1 1 illustrates two examples of conventional prior art 
orthographic projection 11 02 (1 102') at different viewing angles. 
5 Orthographic projections have parallel projection lines 1 104 (11 04') from 
an image 1 106 and perpendicular to an image plane 11 08 (1 108") viewed 
by a viewer or "camera" 1 1 10 (1 1 10'). Alternately, orthographic projection 
1 102 (1 102') may be characterized as viewer or "camera" 1 1 10 (1 1 10') 
viewer observing image plane 1 108 (1 108') along a normal to image plane 

10 1 1 08 (1 1 08'). As illustrated by projection lines 1 1 04', an image plane 1 1 08' 
may be oriented at any angle to image 1 106. 

It has been determined that different adjacent orthographic 
projections have image artifacts analogous to those illustrated in Figs. 1 0A 
and 10B. The image artifacts from orthographic projections arise from the 

15 apparent rotation of image planes 912 (912') and 1 108 (1 108') for different 
viewing angles changing the dimensions, including the shapes, of front 
surfaces of texture objects. In this context, a front surface is the generally 
major surface of a texture object which surface is about parallel to the 
plane of a tile, such as front surfaces 1006 and 1008 in Figs 10A and 10B. 

20 In many applications, such image artifacts would be unacceptably 
noticeable in view-dependent sprited tiles 202 or 404. 

Hence, neither the perspective projection nor the orthographic 
projection is suitable for the sprited tiles utilized in texture mapping 
processes 702 and 802. A texture mapping generated with sprited tiles 

25 generated with these projections would appear improper. 

Fig. 12 illustrates two examples of oblique parallel projection 
1202 (1202') at different viewing angles. Oblique parallel projections have 
parallel projection lines 1204 (1204') from an image 1206 imaged on an 
image plane 1208 (1208') of fixed orientation viewed by a viewer or 

30 "camera" 1210 (1210"). As illustrated, image plane 1208 (1208') is parallel 
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to an object plane 1214 for image 1206. In some applications, image 
plane 1108(11 08') and object plane 1 1 1 4 could be oblique to each otiier. 

In one implementation, sprited tiles for use in texture mapping 
process 702 are generated according to oblique parallel projection 1202 
5 (1202'), or an approximation of it. Oblique parallel projection 1202 (1202') 
Is characterized by different viewing angles being imaged on a common 
image plane, thereby avoiding perspective foreshortening and apparent 
rotation of the image plane with different viewing angles. In addition, for 
images 1206 having front faces (e.g., surfaces 1216), this preserves the 
1 0 relative sizes of the front faces of the images 1 206. As a result, sprited 
tiles for different viewing angles have perceptually consistent 
0 representations at different viewing angles and may be positioned adjacent 

^ each other in a texture mapping without introducing perceptual artifacts 

S such as those from the perspective and orthographic projections, 

jj 1 5 It will be appreciated that some image geometries that could 

m be included in the sprited tiles will not include front faces (e.g., surfaces 

y, 1216). Examples of simple geometries without front faces are spikes, 

Jt pyramids, arbitrary bumps, and cones. Other complex geometries could 

m also not include front faces. Application of oblique parallel projections to 

^ 20 geometries without front faces maintains the benefits of avoiding 

perspective foreshortening and apparent rotation of the image plane with 
different viewing angles. 

With image 1206 represented by a geometry model G in the 
form of, for example, a set of points as is known in the art, a sprited 
25 geometry model corresponding to each sprited tile may be represented by 

in the expression: 

G^ = GMP^(parallel) 
in which P®(parallel) represents the oblique parallel projection matrix for a 
projection at an angle 0 and M represents a modeling matrix that positions 
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image plane 1208 to receive the oblique parallel projection of geometry 
model G. A conventional representation of the oblique parallel projection 

matrix P (parallel) is as: 

"1 0 0 0" 
0 10 0 
0 0 0 0 
0 0 0 1_ 

5 with the modeling matrix M represented asa 4x4 matrix having an upper 
left 3x3 submatrix for scaling and rotating points. An example of such a 
3x3 matrix is: 

sin (9 cos6' 0 
- cos 0 sin 6? 0 
0 0 1_ 

which provides unitary scaling and rotation around the z axis by an angle 
10 Oin the clockwise direction. Rotation about other axes is similar. As is 

known in the art, scaling is provided by multiplicative constants (not shown) 
that are placed on the main diagonal terms for each axis. The bottom row 
of the 4x4 matrix comprises translation terms in each of the x, y, and z 
directions. With reference to the above exemplary 3x3 submatrix, an 
15 exemplary modeling matrix M may be represented as: 

~ sin^ cos^ 0 O' 

-cos^ sin 6^ 0 0 

0 0 10 

X y z \_ 

Application of a sprited tile G to an image surface may be 
represented by the expression: 

G^M^P(perspective) 
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in which M represents a modeling matrix that applies the sprited tile G to 

an Image surface and P(perspectlve) provides the final perspective 
projection of the texture mapped image. 

A result of using oblique parallel projections to obtain sprited 

5 tiles is that Individual tiles do not Include perspective effects. While 
providing for enhanced depth characteristics among multiple tiles of 
different viewing angles, it will be appreciated that the sprited tiles should 
be relatively small relative to the viewing distance of the viewer so that the 
absence of perspective effects within the individual tiles is not noticeable 

10 by the viewer. 

Fig. 13 Is a flow diagram of a method 1300 of generating view 
dependent sprited tiles that each have an Image texture. 

Process block 1302 indicates that multiple selected viewing 
angles are determined for viewing the image texture. 

1 5 Process block 1 304 Indicates that each selected viewing angle 

Is correlated with a predetermined range of viewing angles that Includes 
the selected viewing angle. 

Process block 1306 Indicates that for each of the selected 
viewing angles a data structure (e.g., a two-dimensional image) is formed 

20 to Include a projection of the Image texture relative to the selected viewing 
angles. In one implementation, the Image texture includes a front surface 
with predetermined dimensions and the projections of the image texture 
relative to each of the selected viewing angles maintains the 
predetermined dimensions of the front surface of the image texture. For 

25 example, the projections may be oblique parallel projections. 

An oblique parallel projection may be calculated or determined 
directly by conventional graphics Imaging calculations. In another 
Implementation, approximated oblique parallel projections may be 
determined by distorting the geometry of an Image texture structure by 

30 skewing its geometry while maintaining the dimensions of the front surface 
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of the texture solid. This may be done by displacing the points of the 
object in parallel to the view plane (or front plane) by a distance based on 
the angle of the viewpoint. Points to the rear of the object are displaced 
small amounts, and points to the front are displaced further. In yet another 
5 implementation, approximated oblique parallel projections may be 
determined by obtaining orthographic projections at different viewing 
angles and warping those projections so the dimensions of the front 
surface of the texture solid are maintained. The approximated oblique 
parallel projections are illustrated because relatively few commercial 

1 0 graphics imaging tools support oblique parallel projections. 

Having described and illustrated the principles of our invention 
with reference to an illustrated embodiment, it will be recognized that the 
illustrated embodiment can be modified in arrangement and detail without 
departing from such principles. It should be understood that the programs, 

1 5 processes, or methods described herein are not related or limited to any 
particular type of computer apparatus, unless indicated otherwise. Various 
types of general purpose or specialized computer apparatus may be used 
with or perform operations in accordance with the teachings described 
herein. Elements of the illustrated embodiment shown in software may be 

20 implemented in hardware and vice versa. 

For example, the illustrated embodiments have been directed 
to texture mappings as predominantly structural representations (e.g., solid 
block 206). The illustrated embodiments also include, but do not 
emphasize, an illumination feature in the form of shadows (e.g. shadows 

25 208). It will be appreciated that texture mapping tiles according to the 
present invention may, in addition or as alternatives to structural features, 
employ color, shading, illumination, transparency, as well as other image 
attributes commonly used in texture mapping. The tiles may also include 
effects such as filtering, distance attenuation, reflection, and specular 

30 effects. For example, a shiny metallic wall reflecting light from the sun 
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would have highlights only at particular angles. Also, another 
implementation could account for viewpoint distance, in addition to 
accounting for viewing angle as described, so that different tiles could be 
used to simulate haze or fog when seen from different distances. It will also 
be appreciated that alternatives to the oblique parallel projection could be 
applied to the sprited tiles. For example, in an implementation in which 
image realism or accuracy is not necessarily a rendering goal, tiles may be 
morphed between each other or "hand-painted" or otherwise formed 
manually by a sprited tile designer. 

In view of the many possible embodiments to which the 
principles of our invention may be applied, it should be recognized that the 
detailed embodiments are illustrative only and should not be taken as 
limiting the scope of our invention. Rather, we claim as our invention all 
such embodiments as may come within the scope and spirit of the 
following claims and equivalents thereto. 
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Claims 

1 . A computer-readable medium having stored thereon a tile 
data structure for a tile representing an image texture for tiled texture 
mapping, comprising: 

5 plural tile data structures representing plural respective views 

of the image texture. 

2. The medium of claim 1 in which the plural respective views 
of the image texture are based upon oblique-parallel projections of the 
image texture. 

10 3. The medium of claim 1 in which the plural respective views 

correspond to a range of user viewing angles and each tile data structure 
Q corresponds to a segment in the range of user viewing angles. 

Q 4. The medium of claim 3 in which the segments in the range 

?P of user viewing angles are not equal. 

1 5 5. The medium of claim 4 in which viewing angles are with 

m respect to a predetermined reference and the segments closest to the 

u predetermined reference are smaller that the segments farthest from the 

ll predetermined reference orientation. 

tt 6. The medium of claim 3 in which the segments in the range 

20 of user viewing angles are equal. 

7. The medium of claim 3 in which the range of viewing angles 
extends over viewing angles of positive and negative magnitudes relative 
to a viewpoint position. 

8. The medium of claim 7 in which the segments of viewing 
25 angles of positive magnitudes to which tile data structures correspond are 

matched one-to-one with the segments of viewing angles of negative 
magnitudes to which tile data structures correspond. 

9. The medium of claim 1 in which the plural respective views 
are within only one angular dimension. 
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10. The medium of claim 9 in which the one angular dimension 
is a horizontal angular dimension corresponding to angles within a 
horizontal imaging plane. 

1 1 . The medium of claim 1 in which the plural respective 
views are within only two angular dimensions. 

12. The medium of claim 1 1 in which the two angular 
dimensions are a horizontal angular dimension corresponding to angles 
within a horizontal imaging plane and a vertical angular dimension 
corresponding to angles within a vertical imaging plane. 

13. The medium of claim 1 in which the image texture includes 
an outer face and the outer face is of the same dimensions in each of the 
plural respective views of the image texture. 

14. The medium of claim 1 in which the plural respective 
views of the image texture are based upon morphings of the image texture. 

15. The medium of claim 1 in which the plural respective 
views of the image texture are based upon manually formed renderings of 
the image texture. 

16. A computer method of applying a texture map to an image 
surface in a graphics image rendered on a computer display screen, 
comprising: 

identifying a region of the image surface to which region the 
texture map is to be applied; 

determining a viewing angle for the region; 

correlating the viewing angle with a texture map tile 
corresponding to the viewing angle; and 

rendering the texture map tile at the region on the computer 
display screen. 

17. The computer method of claim 16 in which the texture 
map tile corresponding to the viewing angle is one of plural predetermined 
texture map tiles stored in a computer memory. 
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18. The computer method of claim 16 in which the texture 
map tile corresponding to the viewing angle is calculated based upon the 
determining of the viewing angle. 

19. The computer method of claim 16 in which determining a 
5 viewing angle for the region Includes detennining only one viewing angle 

for the region corresponding to angles within only one imaging plane. 

20. The computer method of claim 19 in which the one 
viewing angle is a horizontal viewing angle corresponding to an angle 
within only a horizontal imaging plane. 

10 21 . The computer method of claim 1 6 in which determining a 

viewing angle for the region includes determining two viewing angles 
corresponding to angles within two transverse imaging planes. 

22. The computer method of claim 21 in which the two viewing 
angles are a horizontal viewing angle and a vertical viewing angle 

15 corresponding to angle within horizontal and vertical imaging planes, 
respectively. 

23. The computer method of claim 16 in which determining a 
viewing angle for the region includes determining only one viewing angle 
for the region corresponding to angles within only one imaging plane. 

20 24. The computer method of claim 1 6 in which the texture map 

tile corresponding to the viewing angle is of a predetermined tile structure 
and includes an oblique parallel projection the predetermined tile structure. 

25. The computer method of claim 16 in which the texture map 
tile corresponding to the viewing angle is of a predetermined tile structure 

25 and includes a morphing of the predetermined tile structure. 

26. The computer method of claim 16 in which in which the 
texture map tile corresponding to the viewing angle is of a predetermined 
tile structure and includes a manually formed renderings of the 
predetermined tile structure. 
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27. A method of generating a tile data structure in a computer 
readable medium representing an image texture for a tiled texture 
mapping, comprising: 

determining plural selected viewing angles for viewing the 
5 image texture; 

correlating each selected viewing angle to a predetermined 
range of viewing angles that includes the selected viewing angle; and 

forming for each of the selected viewing angles a data 
structure that includes a projection of the image texture relative to the 
1 0 selected viewing angles. 

28, The method of claim 27 in which the image texture 
includes a front surface with predetermined dimensions and the projections 
of the image texture relative to the selected viewing angles maintains the 
predetermined dimensions of the front surface of the image texture. 

1 5 29. The method of claim 27 in which the projections of the 

image texture relative to the selected viewing angles are oblique parallel 
projections. 

30. The method of claim 27 in which the plural selected 
viewing angles are within only one angular dimension. 
20 31 . The method of claim 27 in which the plural selected 

viewing angles are within only two angular dimensions. 

32. The medium of claim 27 in which the plural respective 
views of the image texture are based upon morphings of the image texture. 

33. The medium of claim 27 in which the plural respective 

25 views of the image texture are based upon manually formed renderings of 
the image texture. 

34. In a computer readable medium, computer software 
instructions for applying a texture map to an image surface in a graphics 
image rendered on a computer display screen, comprising: 
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software instructions for identifying a region of the image 
surface to which region the texture map is to be applied; 

software instructions for determining a viewing angle for the 

region; 

5 software instructions for correlating the viewing angle with a 

texture map tile corresponding to the viewing angle; and 

software instructions for rendering the texture map tile at the 
region on the computer display screen. 

35. The medium of claim 34 in which the texture map tile 
10 corresponding to the viewing angle is one of plural predetermined texture 
map tiles stored in a computer memory. 
C3 36. The medium of claim 34 in which the texture map tile 

1=^ corresponding to the viewing angle is calculated based upon the 

J"5 determining of the viewing angle. 

1 5 37. The medium of claim 34 in which the texture map tile 

iB corresponding to the viewing angle is of a predetermined tile structure and 

includes an oblique parallel projection the predetermined tile structure. 

38. The medium of claim 34 in which the texture map tile 

CS corresponding to the viewing angle is of a predetermined tile structure and 

ffi 20 includes a morphing of the predetermined tile structure. 

39. The medium of claim 34 in which in which the texture map 
tile corresponding to the viewing angle is of a predetermined tile structure 
and includes a manually formed renderings of the predetermined tile 
structure. 
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VIEW DEPENDENT TILED TEXTURES 

5 

Abstract of the Invention 

An array of view-dependent sprited tiles provide different views 
of an image texture (e.g., structure, color, shading, illumination, 
transparency, as well as other image attributes). The different views of the 

1 0 image texture correspond to different viewing angles at which a user would 
see the tiles when they are applied to an image geometry. In one 
implementation, the view dependent sprited tiles are two-dimensional 
projections of three-dimensional structures. The projections maintain the 
dimensions (including shape) of the front surfaces of three-dimensional 

1 5 structures at different viewing angles. A projection that meets these 
characteristics is the oblique parallel projection. 
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FOR PATENT APPLICATION 

As a below named inventor, 1 hereby declare that: 

My residence, post office address and citizenship are as stated below next to my name, 

I believe I am the original, first and sole inventor (if only one name is listed below) or an 
original, first and joint inventor (if plural names are listed below) of the subject matter which is claimed 
and for which a patent is sought on the invention entitled VIEW DEPENDENT TILED TEXTURES, the 
specification of which 

[X] is attached hereto. 

[ ] was filed on as Application No. . 

[ ] was described and claimed in PCT International Application No. 

, and as amended under PCT Article 19 on 

[ ] and was amended on (if applicable). 

[ ] with amendments through (If applicable). 

I hereby state that I have reviewed and understand the contents of the above-identified 
specification, including the claims, as amended by any amendment referred to above. 

I acknowledge the duty to disclose information which is material to patentability as defined 
in Title 37, Code of Federal Regulations, § 1 .56. If this is a continuation-in-part application filed under 
the conditions specified in 35 U.S.C. § 120 which discloses and claims subject matter in addition to 
that disclosed in the prior copending application, I further acknowledge the duty to disclose material 
information as defined in 37 CFR § 1 .56 which occurred between the filing date of the prior application 
and the national or PCT international filing date of the continuation-in-part application. 

I hereby claim foreign priority benefits under Title 35, United States Code, § 119(a)-(d) of 
any foreign application(s) for patent or inventor's certificate or of any PCT International application(s) 
designating at least one country other than the United States of America listed below and have 
also identified below any foreign application(s) for patent or inventor's certificate or any PCT 
International application(s) designating at least one country other than the United States of America 
filed by me on the same subject matter having a filing date before that of the appiication(s) on which 
priority is claimed: 

Prior Foreign Application(s) Priority 

Claimed 

[] [] 

(Number) (Country) (Day/Month/Year Filed) Yes No 

I hereby claim the benefit under Title 35, United States Code, § 1 19(e) of any United States 
provisional application(s) listed below: 



(Application No.) (Filing Date) 

I hereby claim the benefit under Title 35, United States Code, § 120 of any United States 
application(s) or § 365(c) of any PCT International application(s) designating the United States, listed 
below and, insofar as the subject matter of each of the claims of this application is not disclosed in the 
prior United States or PCT International application in the manner provided by the first paragraph of 
Title 35, United States Code, § 112, I acknowledge the duty to disclose material information as 
defined in Title 37, Code of Federal Regulations, § 1 .56(a) which occurred between the filing date of 
the prior application and the national or PCT International filing date of this application: 



(Application No.) (Filing Date) (Status: patented, pending, abandoned) 



, filed on 

(if applicable). 
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The undersigned hereby authorizes the U.S. attorney or agent named herein to accept and 

follow instructions fronn as to any action to be taken in the Patent and Trademark Office 

regarding this application without direct communication between the U.S. attorney or agent and the 
undersigned, in the event of a change in the persons from whom instructions may be taken, the U.S. 
attorney or agent named herein will be so notified by the undersigned. 

I hereby appoint the following attorney(s) and/or agent(s) to prosecute this application, to 
file a corresponding international application, and to transact all business in the Patent and Trademark 
Office connected therewith: 

Name Reg. No. 

Douglas D. Hancock 35,889 

Patrick W. Hughey 31,169 

Mark M. Meininger 32,428 

Mark A. Porter 35,327 

Katie E. Sako 32,628 

Daniel D. Grouse 32,022 

Address all telephone calls to Mark M. Meininger at telephone number (503) 249-7066. 

Address all correspondence to: 

HANCOCK MEININGER & PORTER LLP 
4370 NE Halsey Street 
Portland, OR 97213 

I hereby declare that all statements made herein of my own knowledge are true and that all 
statements made on information and belief are believed to be true; and further that these statements 
were made with the knowledge that willful false statements and the like so made are punishable by 
fine or imprisonment, or both, under Section 1001 of Title 18 of the United States Code and that such 
willful false statements may jeopardize the validity of the application or any patent issued thereon. 
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